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THE  EFFICIENCY  OF  CERTAIN  PRODUCTION  SYSTEM  IMPI  EMENTATION5 
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Abstract.  In  this  paper,  methods  for  increasing  the  efficiency  of  the  class  of  control 
structures  called  production  systems  are  discussed.  After  briefly  describing  three 
algorithms  for  processing  production  systems,  we  attempt  to  isolate  the  characteristics 
which  most  affect  their  cost.  We  then  present  three  production  systems  to  display 
these  dependencies. 
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I.  INTRODUCTION 

There  has  recently  been  considerable  investigation  in  Artificial  Intelligence  of  a 
class  of  control  structures  called  production  systems.  Production  systems  provide  one 
alternative  for  how  to  organize  an  intelligent  system  [Davis  and  King,  1976; 
feigenbaum,  Buchanan  and  Ledorberg,  1971;  Newell,  1973;  Newell  and  Simon,  1972]. 
This  paper  is  concerned  with  the  efficiency  of  implementation  of  production  systems. 
If  implemented  straightforwardly  according  to  their  definition  (as  is  done  in  most  initial 
and  demonstration  versions),  they  are  quite  expensive,  especially  for  large  systems. 
Thus,  alternative  implementations  must  be  developed.  In  this  paper  we  explore  several 
schemes  and  give  some  experimental  results. 

A production  system  consists  of  a set  of  productions  and  a working  memory. 
Working  memory,  WM,  is  a collection  of  memory  elements.  A production,  ?,  is  a 
conditional  statement  composed  of  zero  or  more  condition  elements  and  zero  or  more 
action  elements.  Whenever  each  condition  element,  C,  in  a production  is  supported  by 
a memory  element,  M,  in  working  memory,  the  production  is  satisfied  and  may  be  fired. 
When  a production  is  fired,  each  action  element.  A,  in  the  production  is  executed,  and 
this  ordinarily  causes  working  memory  to  be  modified  in  some  way;  for  example  a new 
element  might  be  added  lo  working  memory  or  an  element  in  working  memory  might  be 
deleted.  The  basic  unit  of  behavior  is  the  recognition-act  cycle.  The  cycle  has  two 
parts:  (1)  discovering  the  conflict  set,  the  subset  of  satisfied  productions,  and  selecting 
one  of  the  productions  in  the  conflict  set  as  the  production  to  be  fired;  and  then  (2) 
firing  the  production  selected,  ie,  executing  the  action  elements  of  the  production. 
Processing  continues,  cycle  follows  cycle,  until  either  no  production  is  satisfied  or  an 
action  element  explicitly  stops  the  processing. 

As  an  example,  consider  the  following  production  system  whose  production 
memory  contains  three  productions  and  whose  working  memory  is  a list  of  fixed  length 
containing  six  elements: 

PI;  (4 ->  (SAY  GO)  STOP) 

P2;  (<DtGlT>  ->  (SAY  <D1G1T>)  (<DIGIT>  + 1)) 

P3:  (READY ->1) 

Wk<:  (READY  JUNKl  JUNK2  JUNK3  JUNK4  JUNK5) 

Assume  that  when  there  is  more  than  one  production  in  the  conflict  set,  the  first 
satisfied  production  in  order  from  the  top  is  fired.  Given  this  assumption,  at  the 
beginning  of  the  first  cycle,  P3  is  discovered  to  be  satisfied;  it  is  fired  and  this  results 
in  the  number  1 being  added  to  working  memory. 

WM:  (1  READY  JUNKl  JUNK2  JUNK3  JUNK4) 

At  the  beginning  of  the  second,  third,  and  fourth  cycles,  both  P2  and  P3  are  found  to 
be  satisfied;  P2  is  selected  to  be  fired;  the  first  time  it  is  fired,  it  outputs  1 and  then  2 
is  added  to  working  memory;  the  second  time,  2 is  output  and  3 is  added  to  working 
memory;  the  fourth  time,  3 is  output  and  4 is  added  to  working  memory. 
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WM:  (2  1 READY  JUNKl  JUWK2  JUNK3) 

WM;  (3  2 1 READY  JUNKl  JUNK2) 

WM:  (4  3 2 1 READY  JUNKl) 

Finally,  at  the  beginning  of  the  fifth  cycle,  all  three  productions  are  found  to  be 
satisfied;  PI  is  selected;  when  it  is  fired,  it  outputs  GO  and  then  stops  the  processing. 

A production  system  forms  a complete  computational  system.  The  properties 
that  make  it  of  interest  are  its  homogeneous  control  structure,  the  modularily  of  its 
encoding,  the  almost  complete  procedural  representation  and  its  embodiment  of  a 
recognition-act  philosophy  to  determine  what  to  do  next.  We  are  interested  here  only 
in  implementation  schemes  on  standard  uniprocess  computing  systems. 

The  cost  of  a production  system  is  simply  the  per  cycle  cost  of  finding  the 
conflict  set  and  executing  the  action  elements  in  the  production  selected  to  be  fired.  If 
one  uses  the  most  obvious  method  of  determining  which  productions  are  members  of 
the  conflict  set  — testing  the  condition  elements  of  each  production  against  the 
elements  in  working  memory  at  the  beginning  of  each  cycle  --  then  the  time  it  takes  to 
discover  the  conflict  set  can  be  much  greater  than  the  time  taken  by  the  second  stage 
of  the  cycle.  Indeed,  if  a production  system  has  either  a large  number  of  productions 
or  a large  number  of  memory  elements,  then  the  cost  of  the  first  stage  can  be 
prohibitive. 

In  this  paper  we  will  present  some  results  of  an  attempt  to  reduce  the  cost  of 
discovering  the  conflict  set.  Throughout,  we  will  use  a particular  production  system 
architecture,  PSG  [Newell,  1973;  Newell  and  McDermott,  1975],  but  the  considerations 
will  be  applicable  generally.  In  section  II  we  describe  how  production  systems 
processed  by  PSG  discover  the  conflict  set  and  the  heuristics  we  have  used  to  make 
this  processing  more  efficient.  In  section  III  we  present  formulas  for  the  costs  of 
these  various  schemes.  In  section  IV  we  compare  experimentally  the  time 
requirements  of  PSG  when  the  heuristics  are  used  with  the  time  requirements  of  PSG 
alone  for  throe  different  production  systems. 


II.  IMPLEMENTATION  ALGORITHMS 


A production  system  processed  by  PSG  has  a list  of  elements  (M)  as  its 
working  memory  and  contains  a list  of  productions  whose  condition  elements  (C)  are 
either  named  symbols  or  unnamed  lists  of  named  symbols.  To  determine  if  a 
production  is  satisfied,  the  following  three  criteria  are  used;  (1)  every  C must  match  a 
distinct  M;  (2)  a C and  an  M match  only  if  they  have  the  same  name,  or  the  C is  a 
matching  variable,  or  they  match  as  expressions;  (3)  a C and  an  M match  as 
expressions  only  if  the  subelements  of  the  C and  the  subelements  of  the  M are  in  the 
same  order,  the  first  subelement  of  the  C matches  the  first  subelement  of  the  M,  and 
each  subsequent  subelement  of  the  C matches  a subelement  of  the  M.  Thus,  consider 
the  following  working  memory  containing  three  elements 
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WM: 

«E  (F)  G)  D <{I  H))) 

and  the  six  productions 

P4; 

((E  (F)  X)  ((I  X))  ->  ...) 

P5: 

(((F)  G)  ->  ...) 

P6: 

(D  (E  G)  ->  ...) 

P7: 

(((I  H G))  ->  ...) 

P8: 

((d))  -->  ...) 

P9: 

(E  ->  ...) 

If  X is  a variable,  P6  and  P8  would  both  be  satisfied,  while  the  other  four  productions 
would  not. 

PSG  determines  which  productions  are  members  of  the  conflict  set  in  the 
following  way:  At  the  beginning  of  each  cycle,  the  first  condition  element  in  the  first 
production  is  matched  against  each  memory  element  until  a match  is  found.  Then  the 
second  condition  element  is  matched  against  each  memory  element.  This  continues 
until  an  attempted  match  fails  or  until  all  of  the  condition  elements  have  been  found  to 
be  supported,  in  which  case  the  production  is  inserted  into  the  conflict  set.  This 
procedure  is  repeated  for  each  of  the  productions.  We  can  schematize  this  as  follows: 

for  every  P 

SUCCESS  r-  true 
while  SUCCESS 
for  every  C 
FOUND  ♦-  false 
while  not  FOUND 
for  every  M 
if  matchfC,  M) 
then 

FOUND  ♦-  true 

if  final  C then  add  P to  CONFLICT  SET 
else  if  final  M then  SUCCESS  false 

PSG  provides  two  alternative  methods  for  resolving  conflict  in  the  case  of  more 
than  one  production  being  satisfied.  If  production  order  is  used,  productions  are 
tested  in  order  until  the  first  satisfied  one  is  found;  then  that  production  is  fired.  Thus 
for  production  ordni,  no  explicit  conflict  set  is  formed.  If  memory  O'-der  is  used,  all 
productions  are  tested;  then  that  production  in  the  conflict  set  supported  by  the 
memory  element  most  recently  added  to  working  memory  is  fired. 

The  basic  procedure  that  PSG  uses  to  determine  which  productions  are  in  the 
conflict  set  does  not  avail  itself  of  any  of  the  knowledge  that  could  be  obtained  before 
execution  by  determining  which  productions  contain  identical  (or  similar)  condition 
elements.  Nor  does  it  make  use  of  the  information  actually  computed  during  previous 
cycles.  In  other  words,  knowledge  of  which  productions  are  satisfied,  which  condition 
elements  are  supported,  and  what  memory  elements  are  in  working  memory  is  lost  at 
the  end  of  each  cycle  and  thus  must  be  continuously  rediscovered.  The  absence  of 


this  intormation  leads,  of  course,  to  much  redundancy  in  processing.  One  obvious  way 
to  eliminate  this  redundancy  is  to  build  a machine  to  augment  PSG  that  can  store  and 
update  information  that  can  be  helpful  in  determining  whether  productions  are 
satisfied.  A wide  variety  of  such  machines  are  possible;  they  differ  from  one  another 
in  the  information  they  store  and  in  the  ways  that  they  make  use  of  it.  Basically, 
however,  all  of  the  knowledge  which  is  relevant  comes  from  one  of  three  sources. 
These  knowledge  sources  (KSs)  can  be  characterized  as  follows: 

1.  The  Condition-membership  KS  provides  knowledge  about  the  occurrence  of 
condition  elements  in  productions. 

2.  The  Memory-support  KS  provides  knowledge  about  the  memory  elements 
that  support  condition  elements. 

3.  The  Condition-relationship  KS  provides  knowledge  about  the  relationship 
among  condition  elements  within  the  conditions  of  each  production. 

We  give  the  name  filter  to  any  machine  which  uses  such  knowledge  sources  to 
reduce  the  number  of  productions  tested  by  a production  system  architecture.  As 
shown  in  Figure  1,  a filter  admits  to  further  testing  that  subset  of  productions  not 
known  to  be  unsatisfied  on  the  basis  of  whatever  information  is  available  in  the  KSs 
which  it  uses.  The  set  of  productions  passed  through  the  filter  to  full-fledged 
evaluation  is  called  the  P+  set.  To  be  useful  in  a filter,  a KS  must  contain  enough 
information  so  that  a significant  number  of  productions  can  be  excluded  from 
consideration.  The  filter  must  also  be  able  to  store  this  information  in  such  a way  that 
it  can  be  accessed  cheaply  and  (when  necessary)  updated,  so  that  the  cost  of  using 
the  KS  is  significantly  less  than  the  cost  of  processing  the  excluded  productions. 

(P)  — > Filter— > (P+) — >P5G 

t 

KSs 

Figure  1.  PSG  augmented  by  a filter 

Since  a filter  bears  no  responsibility  for  assuring  that  a production  is  satisfied, 
it  depends  on  the  basic  process  (here  represented  by  the  PSG  algorithm)  to  check  the 
final  candidates  in  the  P+  set.  Clearly,  an  alternative  to  using  a few  inexpensive  tests 
to  eliminate  large  numbers  of  productions  from  consideration  is  to  embed  the  sources 
of  knowledge  directly  into  an  algorithm  that  makes  the  full  selection  of  the  production 
to  be  executed.  An  effort  by  Forgy  [1976]  takes  exactly  this  course,  based  on  ideas 
very  similar  to  the  ones  explored  here. 

Knowledge  of  what  conditions  occur  in  the  productions  permits  rejection  of 
productions  whose  conditions  elements  are  not  supported  by  elements  in  working 
memory.  In  other  words,  filters  based  on  the  Condition-membership  KS  can  pass 
productions  all  of  whose  conditions  elements  appear  to  be  supported  by  memory 
elements.  This  does  not  guarantee  that  such  productions  will  be  satisfied:  the  condition 
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elements  may  not  match  the  memory  elements  in  detail  (if  the  filter  is  using  only 
parlial  knowledge);  or  all  conditions  might  match  individually,  but  not  when  considered 
together  (eg,  due  to  instantiation  of  variables).  Given,  for  example, 


PIO:  (D  E ->  ...) 
Pll:  (E  F ->  ...) 
PI 2:  (F  D ->  ...) 
P13:  (DO  ->  ...) 


WM:  (D  F) 

and  given  a KS  containing  the  information  that  PIO,  P12,  and  P13  contain  D,  PIO  and 
Pll  contain  E,  and  Pll  and  P12  contain  F,  a filter  could  match  the  condition  elements 
D,  E,  and  F against  the  elements  in  working  memory  and  then  generate  P+:  {PI 2 P13). 
Only  three  condition  elements  would  be  matched  against  the  elements  in  working 
memory  by  PSG,  rather  than  the  eight  (actually  seven)  which  would  have  to  be 
matched  if  the  information  in  the  Condition-membership  KS  were  not  available. 

The  Memory-supporl  KS  contains  the  knowledge  of  which  condition  elements 
are  supported  by  a memory  element  at  the  beginning  of  a cycle.  This  knowledge  in 
the  Memory-support  KS  complements  that  in  the  Condition-membership  KS.  That  is,  if 
a filler  makes  use  of  both  of  these  KSs,  then  (continuing  with  the  above  example), 
since  the  Memory- support  KS  would  contain  the  information  that  the  condition 
elements  D and  F are  supported,  no  matching  would  be  necessary  at  the  beginning  of 
the  cycle  to  generate  P+:  {PI 2 P13}.  Of  course  the  knowledge  in  the  Memory-support 
KS  must  be  updated  at  the  end  of  each  cycle.  This  updating  involves  matching  the 
elements  being  added  to  and  deleted  from  working  memory  with  each  of  the  condition 
elements,  and  the  cost  of  doing  this  is  primarily  the  cost  of  doing  the  matching.  To 
determine  whether  the  updating  cost  would  be  more  or  less  than  the  cost  of  matching 
each  condition  element  with  the  elements  in  working  memory  at  the  beginning  of  each 
cycle,  one  must  know  the  ratio  of  the  number  of  memory  elements  added  or  deleted 
per  cycle  to  the  number  of  elements  in  working  memory.  If  the  ratio  is  1 to  1,  then 
the  two  costs  are  approximately  the  same. 

The  third  KS,  the  Condition-relationship  KS,  is  probably  of  value  only  if  the 
other  two  KSs  are  also  being  used.  Like  the  Memory-support  KS,  it  contains 
knowledge  which  must  be  updated  during  each  cycle;  this  knowledge  can  be  used  to 
determine  whether  a production,  all  of  whose  condition  elements  are  supported  when 
considered  in  isolation,  is  actually  satisfied.  Consider,  for  example,' 


P13:(D  D ->  ...) 
Pin:  (X  (E  X)  ->  ...) 

WM:  (D  (E  F)) 


j 

1 


3 


whore  X is  a variable  which  will  .match  any  memory  element.  The  knowledge  stored  in 
both  the  Condition-membership  and  Memory-support  KSs  would  not  indicate  that  either 
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of  these  productions  are  unsatisfied,  though  both  are.  The  Condition-relationship  KS 
would  contain  the  information  that  P13  can  be  satisfied  only  if  D occurs  twice  in 
working  memory  and  that  PI  4 can  be  satisfied  only  if  the  variable  X can  be  bound  to 
the  same  symbol  each  time  it  is  instantiated. 

If  one  builds  a filter  that  makes  full  use  of  all  three  KSs,  then  this  filter  can 
generate  conflict  sets  (ie,  P+  sets  that  contain  no  unsatisfied  productions).  Such  a 
filter,  of  course,  eliminates  the  cost  of  testing  (essentially  retesting)  each  production  in 
the  P+  set  to  determine  whether  it  is  satisfied.  However,  the  cost  of  updating  the 
Condition-relationship  KS  can  be  considorablej  whether  or  not  such  a filter  can  be  cost 
effective  is  largely  dependent  on  the  production  system  architecture  which  the  filter  is 
augmenting.  For  an  architecture  like  PSG,  it  is  doubtful  that  the  extra  power  of  such  a 
filter  would  be  worth  the  additional  cost.  PSG  does  not  look  for  more  than  one 
instantiation  of  the  condition  side  of  each  production.  Since  the  probability  is 
ordinarily  high  that  an  instantiation  will  be  found  for  each  production  in  the  P+  sets 
generated  by  a filter  using  the  Condition-membership  KS  (or  both  the 
Condition-membership  and  Memory-support  KSs),  the  high  cost  of  insuring  that  there  is 
such  an  Instantiation  is  likely  to  be  a wasted  expense.  Consequently,  we  have  not  built 
a filter  for  PSG  which  uses  the  Condition-relationship  KS.  Other  architectures, 
howev'er,  particularly  those  which  look  for  all  instantiations  of  the  condition  side  of 
each  production,  are  more  likely  to  benefit  from  being  augmented  by  a filter  which 
generates  conflict  sets  [see  Forgy,  1976]. 

Fillers  need  not  use  full  knowledge,  eg,  of  whether  a condition  element  can 
match  a memory  element.  Good  filter  design  will  trade  off  the  use  of  more  precise 
knowledge  to  obtain  simpler  computation.  For  example,  consider 

P15:  ((D)  (E  F)  ->  ...) 

P16;((DX)(J  G)->...) 

P17:  ((DXYMIY)  ->  ...) 

WM:  ((D  E F)  (1  E F G)) 

where  X and  Y are  variables.  A filter  using  the  Condition-membership  KS,  as  described 
above,  would  have  to  match  each  of  the  six  condition  elements  with  the  elements  in 
working  memory  to  generate  P+;  {P16  P17},  If,  on  the  other  hand,  the  KS  contained  no 
explicit  references  to  specific  elements,  but  instead  contained  only  information  about 
classes  of  elements  --  where  the  classes  might  be  condition  elements  whose  first 
syn-bol  is  D,  condition  elements  whose  first  symbol  is  E,  and  so  on  --  then  only  three 
matches  would  be  needed  to  generate  the  same  P+  set,  and  each  of  the  matches  would 
involve  comparing  only  a single  pair  of  symbols.  Such  a heuristic  does  have  its 
failings.  Consider 

P18:  ((D  E)  ->  ...) 

P19:  ((D  F)  ->  ...) 

P20:  ((D  G)  ->  ...) 


WM;  ((D  E)) 
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Uiiing  the  heuristic,  P+:  {P18  P19  P20}  would  be  generated,  whereas  not  using  the 
heuristic  would  yield  P+:  {P18}.  Nevertheless,  the  idea  of  exploring  class 
representations  for  the  KSs  is  attractive.  Both  of  the  filters  which  we  have 
implemented  are  efforts  in  tl  ' direction. 

Productions  may  also  contain  negative  condition  elements;  in  this  case,  a 
production  is  satisfied  only  if  the  condition  element  is  not  supported  by  any  element  in 
working  memory,  in  PSG,  a condition  element  is  negated  by  placing  the  symbol  ABS 
after  it.  For  example,  consider 

P21:  ((F  X)  (E  X)  ABS  ->  ...) 

P22:  t(D  X)  (E  X)  ABS  ->  ...) 

WM:  «F  H)  (D  D)  (E  H)) 


where  X is  a variable.  P21  is  not  satisfied  (X  will  be  bound  to  H and  the  element  (E  H) 
is  not  absent  from  working  memory);  but  P22  is  satisfied  (X  will  be  bound  to  0 and  the 
element  (E  D)  is  absent  from  working  memory).  The  ABS  construct  causes  t;  problem 
for  any  filter  which  does  not  make  use  of  the  Condition-relationship  KS.  If,  for 
instance,  we  made  no  special  provision  for  ABS  condition  elements  and  constructed  a 
filter  which  made  use  of  either  of  the  Condition-membership  KSs  representations 
described  above,  then  since  the  condition  element  (E  X)  considered  in  isolation  is 
supported,  the  filter  would  incorrectly  generate  an  empty  P+  set.  One  solution  to  this 
problem,  and  the  one  we  have  adopted  here,  is  to  design  filters  that  ignore  ABS 
condition  elements.  No  information  at  all  about  the  second  condition  elements  in  P21 
and  P22  would  be  stored  in  the  KS.  Thus  from  the  point  of  view  of  the  filter,  the  two 
productions  above  would  each  contain  only  a single  condition  element. 

A Condition-membership  Filter 

One  of  the  two  filters  we  have  constructed  makes  use  ot  the 
Condition-membership  KS  exclusively;  we  have  (somewhat  unimaginatively)  given  it  the 
name  CmF.  The  KS  is  a discrimination  net  which  indicates  which  productions  contain 
similar  condition  elements.  Here  similar  means  having  the  same  first  named  symbol  or 
primary  feature  (PF).  Each  node  in  the  network  is  a single  primary  feature  and  thus 
represents  all  condition  elements  which  have  that  feature  as  their  first  named  symbol. 
The  full  CmF  has  nodes  corresponding  to  earh  feature  in  the  production  system  being 
processed.  A partial  CmF  has  nodes  corresponding  to  only  some  ot  the  features. 

At  the  beginning  of  a run  (a  sequence  of  recognition-act  cycles),  a list  of  pairs 
is  generated;  each  pair  contains  a primary  feature  and  the  set  of  productions  which  ^ 
not  contain  a condition  element  with  that  feature.  This  list  is  ordered  by  increasing 
size  of  the  sets  of  productions.  Then  the  primary  feature  with  the  smallest  set  of 
associated  productions  (ie,  the  feature  excluding  the  largest  number  of  productions)  is 
selected  as  the  top  node  of  the  discrimination  net.  This  node  has  two  successors.  Its 
no  successor  is  the  feature  on  the  li:t  which  excludes  the  second  largest  number  of 
productions;  the  no  successor  of  this  node  is  the  feature  on  the  list  which  excludes  the 
third  largest  number  of  productions,  and  so  on.  The  yes  successor  of  the  top  node 
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(and  of  each  of  the  other  nodes  in  the  tree)  is  found  by  reordering  the  list  on  the 
basis  of  how  many  additional  productions  are  excluded  by  each  remaining  feature;  the 
feature  which  excludes  the  largest  number  of  additional  productions  is  the  yes 
successor;  its  no  successor  is  the  feature  on  the  reordered  list  which  excludes  the 
second  largest  number  of  productions,  and  so  on,  as  above.  Nodes  continue  to  be 
generated  until  the  list  of  features  is  empty  or  until  the  net  is  of  a stipulated  size.  ^ 
Given  the  productions 

P23:  ((D  E)  ((G))  ->  . . .) 

P24:  <(0  <E»  (0  F)  ->  . . .) 

P?5;  (M  ->  . . .) 

the  discrimination  net  m Figure  2a  would  be  produced.  (Note  that  the  arcs  (hat  extend 
to  the  left  are  all  no  arcs  and  those  that  extend  to  the  right  are  yes  arcs.) 

At  the  beginni.ng  of  each  cycle,  a set  containing  the  primary  feature  of  each 
memory  element  in  working  memory  is  generated.  Then  the  discrimination  net  is 
traversed  by  testing  whether  the  current  node  is  a member  of  this  feature  set.  If  it  is 
not,  then  only  the  productions  associated  with  the  terminal  node  descendants  of  that 
node  can  possibly  be  sahsfied,  so  the  yes -successor  is  tested.  If,  on  the  other  hand, 
the  current  node  is  a member  of  the  feature  set,  no  information  has  been  gained;  to 
discover  which  productions  (if  any)  can  be  excluded,  the  no-successor  is  tested.  When 
a terminal  node  is  encountered,  the  list  of  possibly  satisfied  productions  associated 
with  that  node  becomes  the  P*  set.  Schematically  we  have: 

for  every  M add  PF  rf  M to  WM  FEATlJItE  SET 
for  I «-  1 thru  N where  N is  depth  of  NET 
if  NOTE  .*v  in  WM  FEATUI?E  SET 
then  descend  to  the  NO  SUCCESSOR 
eise  descend  to  the  YES-SUCCESSOR 
P*  SET  ♦-  productions  associated  with  terminal  node 


A Condition-membership  Memory-support  Filter 

We  have  implemented  three  versions  of  a second  filter  which  makes  use  of 
both  the  Condition-membership  and  the  Memory-support  KSs.  The  three  versions 
differ  from  one  another  only  in  the  set  of  features  they  use  to  represent  condition 
elements.  Since  they  use  both  the  Condition-membership  and  the  Memory-support 
KSs,  we  call  them  CmMsFl,  CmMsF2,  and  CmMsF3.  > 

CmMr.Fl,  like  CmF,  uses  only  the  primary  feature  to  represent  a condition 
element.  At  the  beginning  of  a run  a set  of  associations  are  set  up,  as  illustrated  in 
Figure  2b.  Each  primary  feature  is  associated  with  the  list  of  those  condition  elements 
which  it  represents;  then  each  condition  element  is  associated  with  the  list  of 
productions  containing  it.  In  addition,  the  number  of  condition  elements  contained  in 


2 The  reordering  procedure  is  useful  only  lor  partial  nets;  it  guarantees  that  the  net 
produced  is  the  most  effective  net  of  its  size. 
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Figure  Z.  Represcntmion  of  PZ3-P25  for 
(a) CmF,  (b)CmMsFl, (OCmMsFZ,  ano 
(d)  CmMsF5 
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each  production  is  associated  with  that  production;  this  number  is  used  to  keep  track 
of  the  number  of  condition  elements  in  the  production  which  are  not  supported  by  a 
memory  element.  Once  the  associations  are  established,  working  memory  is  searched 
to  determine  which  condition  elements  are  supported;  those  productions  which  are 
fully  supported  are  put  in  the  P+  set. 

During  each  cycle,  whenever  a memory  element  enters  or  leaves  working 
memory,  its  primary  feature  is  generated;  the  set  of  condition  elements  associated  with 
this  feature  is  found  and  then  the  sets  of  productions  containing  these  condition 
elements.  If  the  memory  element  is  entering  working  memory,  then  for  each  of  these 
productions,  the  number  of  condition  elements  in  the  production  which  are  not 
supported  is  decremented  by  one;  if  the  resulting  number  is  less  than  or  equal  to  zero 
(ie,  if  the  production  is  fully  supported),  it  is  retagged  satisfied.  If  the  memory 
element  is  leaving  working  memory,  then  for  each  production  the  number  is 
incremented  by  one;  if  the  resulting  number  is  greater  than  zero  (ie,  if  the  production 
is  not  fully  supported),  it  is  tagged  unsatisfied.  Then  before  each  cycle,  those 
productions  tagged  satisfied  aie  put  into  the  P+  set.  Schematically, 

X «-  PF  of  M entering  WM 
for  every  C with  X as  PF 
for  every  P with  C 

decrement  number  of  unsupported  Cs  by  1 
if  number  of  unsupported  Cs  < 1 then  tag  P satisfied 

X ♦-  PF  of  M leaving  WM 
for  every  C with  X as  PF 
for  every  P with  C 

increment  number  of  unsupported  Cs  by  1 

if  number  of  unsupported  Cs  > 0 then  tag  P unsatisfied 

for  every  P 

if  P is  fagged  satisfied  then  add  P to  P+  SET 

CmMr.F2  is  identical  to  CmKArFl,  except  in  its  representation  of  condition 
elements.  CmMr.F2  uses  both  a primary  feature  and  a list  of  features,  which  we  call 
secondary  features,  indicating  the  position,  but  not  the  depth,  of  each  named  symbol. 
For  example,  the  condition  element  (D  ((E)  F))  is  represented  as  (ID  2E  3F),  where  1,  2, 
and  3 simply  indicate  the  order  of  the  named  subelements.  CmMsF2  is  more 
discriminating  than  CmMsFl.  At  the  beginning  of  a run,  CmMr.F2,  instead  of  directly 
associating  each  primary  feature  with  a set  of  condition  elements,  associates  each 
primary  feature  with  a set  of  secondary  feature  lists  (SFLs);  each  feature  list  is  then 
associated  with  the  set  of  condition  elements  which  it  represents.  Figure  2c  displays 
these  indirect  associations.  During  each  cycle,  after  the  primary  feature  of  the 
memory  element  entering  or  leaving  working  memory  has  been  generated,  the  list  of 
secondary  features  of  the  memory  element  is  generated;  the  secondary  feature  lists 
associated  with  the  primary  feature  are  then  matched  with  the  list  of  secondary 
features  of  the  memory  element.  A condition  element  feature  list  matches  a memory 
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element  feature  list  if  all  of  its  elements  are  contained  in  the  memory  element  feature 
list  and  if  the/  are  in  the  same  order.  A feature  which  represents  a variable  is  never 
bound  and  thus  can  always  match  any  element.  The  productions  containing  the 
condilion  elements  represented  by  the  secondary  feature  lists  which  matched 
successfully  are  updated  as  in  CmMsFl. 

X «-  PF  of  M entering  WM 

Y «-  SFL  of  M entering  WM 

for  every  SFL  associated  with  X 
if  malchfSFL,  Y)  then  add  associated  C to  CSET 

for  every  C in  CSET 
for  es'ery  P with  C 

decrement  number  of  unsupported  Cs  by  1 
if  number  of  unsupported  Cs  < 1 then  tag  P satisfied 

X PF  of  M leaving  WM 

Y SFL  of  M leaving  WM 

for  every  SFL  associated  with  X 
if  matchfSFL,  Y)  then  add  associated  C to  CSET 

for  every  C in  CSET 
for  every  P with  C 

increment  number  of  unsupported  Cs  by  1 

if  number  of  unsupported  Cs  > 0 then  tag  P unsatisfied 

for  every  P 

if  P is  tagged  satisfied  then  add  P to  P+  SET 

CmMr.F3  uses  both  a primary  feature  and  a list  of  secondary  features  indicating 
the  depth  as  well  as  the  position  of  each  named  symbol  to  represent  condition 
elements,  For  example  the  condition  element  (D  ((E)  F))  is  represented  as  (IDl  2E3 
3F2),  where  the  numbers  following  the  named  subelements  indicate  the  depth  of  that 
subelement.  While  CmMr.F3  is  more  discriminating  than  CmMsF2,  it  differs  from 
CmMv.F2  only  in  the  procedure  it  uses  to  match  the  secondary  feature  lists  with  the  list 
of  secondary  features  of  the  memory  element  entering  or  leaving  working  memory. 
Figure  2d  illustrates  the  associations  used  bv  CmMsFS. 


in.  DERIVATION  OF  COST  FORMULAS 

In  this  section  we  give  formulas  that  predict  the  cost  of  PSG  and  PSG 
augmented  by  the  various  filters.  The  formulas  arise  from  an  analysis  of  the  structure 
of  the  algorithm  (as  embedded  in  the  actual  cc»de)  coupled  with  various  simplifying 
statistical  assumptions  about  the  nature  of  the  task  environment.  We  are  primarily 
interested  in  assessing  the  major  fr-ctors  affecting  the  cost  of  a cycle,  T.CYCLE.  This 
could  bo  accomplished  by  using  the  formulas  to  argue  for  the  form  of  the  relationship 
and  then  verifying  this  with  experimental  data,  determining  the  constants  so  as  to 
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' produce  » good  fit  to  the  data.  Alternatively,  the  formulas  can  be  made  sufficiently 

i precise  to  produce  absolute  predictions  of  the  time  taken  under  various  experimental 

I conditions.  We  have  chosen  this  later  course,  since  it  is  an  interesting  side  question 

' how  good  such  cost  formulas  can  be. 

It  should  be  evident  from  our  description  of  PSG’s  basic  algorithm  that  two 
important  factors  determining  the  cost  of  PSG  when  it  is  not  augmented  by  a filter  are 
the  size  of  production  memory  and  the  size  of  working  memory.  This  shows  up  In  the 
simplest  approximation  to  the  actual  per  cycle  cost  of  PSG,  which  is 

( 1 ) T.CYCLE  - CONDITION  COST  4 ACTION  COST 

i - (P  ♦ M ♦ T.kCH)  4 ((A/P)  ♦ T.ACT) 

I P is  the  number  of  productions  in  production  memory 

t M is  the  number  of  elements  in  working  memory 

; T.K4CH  is  the  time  to  match  a condition  element  with  a memory  element 

A is  the  number  of  action  elements 

A/P  is  the  average  number  of  actions  per  production 
T.ACT  is  the  time  to  execute  one  action  element. 

This  formula  actually  yields  a value  which  is  close  to  a lower  bound  for  the  per  cycle 
cost  of  a basic  implementation  for  a production  system  with  memory  order  for  conflict 
resolution.  If  the  number  of  condition  elements  in  each  production  is  close  to  1,  or  if 
the  number  of  first  condition  elements  which  are  supported  by  elements  in  working 
memory  is  close  to  0,  then  this  formula  is  a fair  approximation. 

For  production  systems  whose  conflict  resolution  strategy  is  production  order, 
a better  approximation  is 

(2)  T.CYCLE  - (((P  4 l)/(CS  4 1))  ♦ M » T.MCH)  4 «A/P)  ♦ T.ACT) 

I CS  is  the  average  number  of  productions  in  the  conflict  set 

i 

F 

This  takes  into  account  that  the  system  quits  as  soon  as  it  finds  the  first  acceptable 
' production,  so  that  it  searches  only  (P4l)/(CS4l)  productions  instead  of  P. 

I These  two  formulas  make  clear  that  the  basic  algorithm  is  linear  jointly  in  P and 

i M,  with  either  conflict  resolution  regime.  The  cost  addition  of  the  action  side  will  be 

I negligible  for  large  systems  (either  large  P or  K4),  as  long  as  the  number  of  actions  per 

production  remains  modest  (which  is  true  of  all  systems  envisioned  to  date,  since  the 
action  sequence  is  required  to  be  unconditional,  hence  is  basically  limited).  Though 
most  architectures  opt  for  small  or  modest  working  memory  (M  from  5 to  30), 
production  systems  to  be  effective  must  have  a large  P (thousands  or  even  much 
more).  Though  production  order  (formula  (2))  effectively  divides  P by  (CS  4 1),  the  size 
of  the  conflict  set  is  not  under  deliberate  control  and  it  is  unclear  whether  a 
production  system  with  very  large  CS  would  be  viable,  since  it  implies  substantial  lack 
of  directionality. 

When  a filter  is  added  to  PSG,  the  per  cycle  cost  can  be  approximated  as 

(3)  T.CYCLE  - T.FILTER  4 (P  • M ♦ T.MCH)  4 ((A/P)  a T.ACT) 
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P’  is  the  number  of  productions  in  the  P+  set  which  are  tested 
For  production  order,  P’  = (P+  + 1)/(CS  ♦ 1) 

For  meniory  order,  P’  = P+ 

The  main  effect  of  the  filter  according  to  formula  (3)  is  to  cut  down  the  effective 
number  of  productions,  leaving  everything  else  unchanged,  and  adding  a cost  due  to 
the  filter  which  is  unknown  until  specific  designs  are  considered. 

Formulas  (l)-(3)  have  some  serious  weaknesses.  They  do  not  take  into  account 
the  number  of  supported  condition  elements  which  are  likely  to  be  tested.  Formula  (3) 
is  particularly  weak  since  if  does  not  take  into  accou'.t  the  possibility  that,  besides 
decreasing  the  number  of  productions,  the  filter  may  also  decrease  the  number  of 
memory  elements  with  which  a condition  element  is  matched.  A more  adequate 
formula,  then,  is  the  following: 

(4)  T.CYCLF= 

T.Fil.TliR  + 

(MCH+P-  ♦ T.KCH+)  + (MCH-P-  » T.MCH-)  + 

(MCH+P+  ♦ T.MCH+)  + (MCH-P+  ♦ T.MCH-)  + 

(A/P>  ♦ T.ACT 

The  second  and  third  linns  of  formula  (4)  separate  the  cost  of  processing  productions 
that  are  not  satisfied  from  the  cost  of  processing  satisfied  productions;  within  each 
line,  the  cost  of  matching  condition  elements  with  their  supporting  memory  elements  is 
separated  from  the  cost  of  affempting  to  match  condition  elements  with  memory 
elements  which  do  not  support  them.  Thus: 

MCH+P-  The  number  of  successful  matches  on  Ps  that  fail 
MCH-P-  The  number  of  unsuccessful  matches  On  Ps  that  fail 
MCH+P+  The  number  of  successful  matches  on  Ps  that  succeed 
MCH-P+  The  number  of  unsuccessful  matches  on  Ps  that  succeed 

The  adequacy  of  (4)  depends  on  the  closeness  with  which  MCH+P-,  MCH-P-, 
MCH+P+,  and  MCH-P+  can  bo  approximated  in  terms  of  basic  characteristics  of 
production  systems.  These  values  can  be  estimated  using  the  following  information: 

P The  number  of  productions  in  production  memory 

CS  The  average  number  of  productions  in  the  conflict  set 

M The  avet  age  number  of  elements  in  working  mempry 

C The  number  of  condition  elements 

CD  The  number  of  distinct,  non  ABS  condition  elements 

C.ABS  The  number  of  ABS  condition  elements 

PF  The  number  of  distinct  primary  features 

SFL  The  number  of  distinct  feature  lists 

F The  number  of  features  (named  symbols) 

FV  The  number  of  features  which  are  free  variables 

LPF  The  average  depth  of  the  primary  feature 

NTC  The  number  of  NTCs 

A The  number  of  action  elements  (excluding  NTCs) 
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All  but  one  of  these  quantities  are  static;  that  is,  they  can  be  determined  without 
running  the  production  system.  The  other,  CS,  though  it  can  be  computed  exactly  only 
at  the  end  of  a run,  can  be  estimated  with  some  accuracy  by  the  designer  of  the 
production  system  since  the  capabilities  of  a production  system  are  to  a considerable 
extent  a kinction  of  the  size  of  its  conflict  set.  NTC  is  one  of  the  commands  which  can 
occur  in  an  action  element.  Its  function  is  to  find  an  element  in  working  memory  which 
matches  its  argument;  thus  we  include  the  cost  of  NTC  as  part  of  the  condition  cost. 

The  estimated-cost  formula  for  PSG  using  this  information  is  given  below.  The 
formula  reflects  accurately  the  structure  of  the  algorithm  down  to  the  level  of  the 
matching  routines.  Thus,  each  time  constant  corresponds  to  a particular  Isolated 
subpiece  of  code.  Each  routine  was  timed  independently  by  running  Icops  Involving 
only  that  piece  of  code.  All  times  are  in  milliseconds  (ms).  ^ 

(5)  T.PSG  - 
0 ♦ 

P’-  ♦ (1/(CD  - D)  * T.MCH+  + 

P’-  ♦ (((1/(CD  - D)  ♦ ((M  - l)/2))  + M)  ♦ T.MCH-  ♦ 

P’+  * (((C  - C.ABS)  + NTO/P)  * T.MCH*  + 

P’-»  ♦ «(((C  - C.ABS)  + NTO/P)  * «M  - l)/2))  + ((C.A0S/P)  * M))  ♦ T.MCH-  ♦ 
(A/P)  ♦ T.ACT 

P’-  Is  the  number  of  unsatisfied  productions  tested; 

For  production  order,  P’-  ■ (P  - CS)/(CS  + 1). 

For  memory  order,  P’-  “ P - CS. 

T.MCH+  is  the  lime  it  takes  to  match  a supported  C with  its  supporting  M: 
T.MCH*  = (LPF  ♦ 28)  * (((F  - FV)/C)  » 6)  * ((FV/C)  ♦ 18)  + 15. 

T.MCH-  is  the  lime  it  takes  to  attempt  to  match  a C with  an  M which  does 

not  support  it: 

Tl.MCH- = (LPF  * 28)  ♦ 15. 

P’*  is  the  number  of  satisfied  productions  tested: 

For  production  order,  P’*  - 1. 

For  memt  ry  order,  P’*  •»  CS. 

T.ACT  is  the  time  it  takes  to  execute  one  action  element; 

T.ACT  - 72. 

In  the  second  lino  of  (5),  MCH*P-  is  approximated  by  taking  the  product  of  the  number 
of  unsatisfied  productions  tested  and  the  number  of  supported  condition  elements  In 
each  production  before  the  first  unsupported  one  is  found.  In  the  third  line,  t,^H-P-  is 
approximated  by  taking  the  sum  of  two  products:  the  first  give?  the  number  of 
unsuccessful  matches  which  occurred  in  conjunction  with  the  condition  elements  which 
were  found  to  be  supported;  the  second  product  is  simply  the  number  of  unsatisfied 
productions  tested  multiplied  by  the  number  of  elements  in  working  memory.  In  the 
fourth  line,  MCH*P*  is  approximated  by  multiplying  the  number  of  satisfied  productions 
tested  by  the  number  of  non-ABS  condition  elements  (including  NTCs)  per  production. 


3 The  version  of  PSG  which  we  used  is  coded  in  the  list  processing,  implementation 
language  L*(H)  and  was  run  on  a PDP-10,  model  KA.  The  system  was  running  in  a 
basically  interpretive  mode  and  no  attempt  was  made  to  optimize  the  code  locally. 
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In  thfi  fifth  line,  MCH-P+  is  approximated  by  taking  this  same  product  and  multiplying  it 
by  the  number  of  elements  in  working  memory  with  which  a match  was  attempted 
before  a successful  match  was  found;  then  the  number  of  ABS  condition  elements  per 
production  times  the  number  of  memory  elements  in  working  memory  is  added  to  that 
product.  In  the  sixth  line,  the  action  cost  is  estimated  by  multiplying  the  average 
number  of  action  elements  in  each  production  by  the  cost  of  executing  an  action 
element. 

The  estimated-cost  formula  for  PSG.CmF  is 

(6)  T.PSG.CmF  = 

M * (T.SET  + (PF  ♦ T.NFT))  + 

P’-  ♦ (1/((P+  * (C/P))  - D)  * T.MCH+  + 

P’-  * (((1/((P+  ♦ (C/P))  - D)  * ((M  - l)/2))  + M)  * T.MCH-  + 

P’+  * (((C  - C.AB5)  + NTO/P)  * T.MCH+  + 

P’+  * (((((C  - C.ABS)  + NTO/P)  ♦ ((M  - l)/2))  + ((C.ABS/P)  * M))  * T.MCH-  ♦ 
(A/P)  * T.ACT 

T.SET  is  the  tin  e it  takes  to  generate  the  PF  of  one  M: 

T.SET  = 10. 

T.NIIT  is  the  time  it  takes  to  test  whether  the  PF  of  a C is  the  same  as 

the  PF  of  one  M: 

T.NCT  = 2. 

P’-  is  the  number  of  unsatisfied  productions  tested: 

For  production  order,  P’-  = (P+  - CS)/(CS  + 1). 

For  memory  order,  P’-  = P+  - CS. 

P+  is  the  number  of  productions  admitted  to  further  testing: 

P+  = CS  * (((C  - C.ABS)/PF)  r (P/(C  - C.ABS))). 

P’+  is  the  number  of  satisfied  productions  tested: 

For  production  order,  P’+  = 1. 

For  memory  order,  P’+  = CS. 

In  the  first  line  of  (6),  T.F1I.TER  is  approximated  by  multiplying  the  time  it  takes  to 
generate  the  PF  of  one  M plus  Ihe  time  it  takes  to  search  the  net  given  one  M by  the 
number  of  elements  in  working  memory.  The  second  and  third  lines  of  this  formula  are 
the  same  as  the  second  and  third  lines  of  formula  (5)  except  P+  is  substituted  for  P in 
P’-  and  the  probability  that  a C (in  a production  in  the  P+  set)  matches  an  M is  1/(P+  ♦ 
(C/P))  instead  of  1/CD.  P+  is  approximated  by  multiplying  CS  by  the  average  number 
of  condition  elements  that  are  the  same  with  respect  to  their  primary  feature  raised  to 
the  inverse  of  the  average  number  of  condition  elements  in  each  p.  The  remaining 
lines  of  (6)  are  identical  to  the  fourth,  fifth,  and  sixth  lines  of  (5). 

PSG.CmF  is  useful  as  a partial  filter  only  when  some  subset  of  features,  PRTF, 
essentially  partiluns  the  production  system  into  a number  of  sets  equal  to  the  number 
of  features  in  that  subset.  When  this  situation  obtains,  the  cost  formula  is  the  same  as 
(6),  except  that  P*  is  {I /PRTF)  * P and  the  filter  cost  is  M * (T.SET  + (PRTF  ♦ T.NET)). 

The  estimated-cost  formula  for  PSG.CmMsF  is 


t 


a 
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(7)  T.PSG.CmMr.F  « 

«A/P)  * (C/F’>  ♦ LPF  ♦ (T.PFT  + (K  * T.FLT))  + 

P’-  ♦ (1/((P+  ♦ (C/P))  - D)  ♦ T.MCH+  + 

P’-  ♦ («C  - C.ABS)/C)  4 ((C.ABS/C)  * (M/2)))  ♦ T.MCH-  4 
1 * (((C  -C.ABS)  4 NTO/P)  * T.MCH4  4 
1 * ((C.ABS/P)  * M)  ♦ T.MCH-  4 
(A/P)  ♦ T.ACT 

F’  is  tfip  number  of  distinct  primary  features  or  distinct  feature  lists: 

For  PSG.CmMr.Fl,  F’  - PF. 

For  PSG.CmMr.F2  and  PSaCmMsF3,  F’  = SFL. 

K is  the  factor  by  which  T.FLT  is  multiplied  dependinf,  on  which  version 
of  CmMr.F  is  being  used 
For  PSG.CmMr.Fl,  K = 0. 

For  PSG.CmMr.F2,  K = 1. 

For  PSG.CmMr.F3,  K = 2. 

T.PFT  is  the  time  it  takes  PSG.CmMsFl  to  keep  track  of  which  Cs  have  a 
primary  feature  in  working  memory: 

T.PFT  = 30. 

T.FLT  is  the  time  it  takes  PSG.CmMr.F2  to  keep  track  of  which  Cs  have  a 
feature  list  in  working  memory; 

T.FLT  = 78. 

P’-  is  the  number  of  unsatisfied  productions  tested: 

P'~  = (P4  - CS)/(CS  4 1) 

P4  is  the  number  of  productions  admitted  to  further  testing: 

P4  = CS  ♦ (((C  - C.ABS)/F’)  t (P/(C  - C.ABS))). 

T.MCH-  is  the  time  if  fakes  to  affempf  to  match  a C with  an  M which  does 
not  support  it: 

T.MCH-  = (LPF  ♦ 28)  4 21. 

In  the  first  line  of  formula  (7),  T.FILTER  is  approximated  by  multiplying  the  number  of 
modifications  to  working  memory  by  the  number  of  condition  elements  associated  with 
each  distinct  primary  feature  or  distinct  feature  list  and  that  by  the  average  depth  of 
the  primary  feature  and  then  multiplying  this  product  by  the  time  it  takes  to  keep 
track  of  which  condition  elements  are  at  least  partially  supported  by  which  memory 
elements.  The  second  and  third  lines  of  this  formula  are  the  same  as  the  second  and 
third  lines  of  (6),  except:  P’-  is  always  (P4  - CS)/(CS  + l)i  each  C is  matched  with 
approximately  one  M rather  than  with  half  of  the  elements  of  working  memory  for 
supported  Cs  and  all  of  the  elements  of  working  memory  for  unsupported  Csi  and  the 
time  it  takes  to  attempt  to  match  a C v'ith  a non-supporting  M is  slig^htly  greater  since 
no  C is  matched  with  an  M which  does  not  have  at  least  the  same  primary  feature. 
The  fourth  and  fifth  linos  of  the  formula  arc  the  same  as  the  fourth  and  fifth  lines  of 
(6),  except:  P'4  is  always  1;  and  each  non  ABS  condition  element  is  matched  with  just 
one  memory  element.  The  sixth  lines  of  the  two  formulas  are  identical. 

If  the  formulas  (5)-(7)  are  accurate,  then  we  can  make  the  following  general 
statements  about  the  efficiency  of  production  system  architectures:  (1)  An  architecture 
which  does  not  make  use  of  a filter  has  a cost  which  is  roughly  linear  in  the  product  of 
P and  M.  Each  unsatisfied  production  tested  involves  at  least  M matches.  An  additional 
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N * (M/2:)  marches  will  be  needed  (or  each  unsatisfied  production  whose  first  N 
condition  elements  are  supported  by  memory  elements;  however,  for  large  P and  small 
M,  this  number  will  be  insignificant.  The  number  of  matches  needed  to  test  a satisfied 
production  is  C/P  * «M  - l)/2  + 1);  this  number  likewise  will  be  insignificant  for  large 
P unless  M (or  CS)  is  correspondingly  large.  (2)  A production  system  architecture 
augmented  by  a filter  which  makes  use  of  a Condition-membership  KS  has  a cost  which 
is  roughly  linear  in  the  product  of  P+  and  M.  The  number  of  matches  needed  to  test 
an  unsatisfied  production  will  ordinarily  be  higher  for  a system  augmented  by  a filter 
since  presumably  the  productions  in  the  P+  set  contain  a larger  number  of  supported 
condition  elements  than  do  the  productions  not  in  the  P+  set.  The  number  of  matches 
needed  fo  test  a satisfied  production  is  the  same  as  for  an  architecture  not  augmented 
by  a filler.  Because  production  systems  typically  have  many  productions,  but  only  a 
small  working  memory,  the  Condition-membership  KS  can  be  viewed  as  the  most  crucial 
of  the  knowledge  sources  since  it  eliminates  the  cost  dependency  on  P.  (3)  An 
architecture  augmented  by  a filter  which  makes  use  of  both  the  Memory-support  KS 
and  the  Condition-membership  KS  has  a cost  which  is  linear  only  in  P+.  Since  each 
non-negated  condilion  element  is  associated  with  those  memory  elements  that  appear 
to  support  it,  often  only  one  match  will  be  involved  in  testing  an  unsatisfied 
production,  and  only  rarely  will  more  than  C/P  matches  be  necessary.  The  number  of 
matches  needed  to  test  a satisfied  production  is  just  C/P.  By  providing  information 
which  makes  the  searching  of  working  memory  unnecessary,  the  Memory-support  KS 
eliminates  the  cost  dependency  on  M. 


IV.  EXPERIMENTAL  RESULTS 


This  section  is  divided  into  three  parts.  Each  part  considers  one  of  the  three 
production  systems  we  used  for  gathering  cost  data,  and  includes  a brief  description  of 
the  production  system  involved,  a table  displaying  the  predicted  and  measured  costs 
for  Ihe  runs,  with  and  without  filtering,  and  a discussion  of  the  discrepancies  between 
the  predicted  and  measured  costs. 

PSCCIi  Testing  Variations  in  Processing 

The  first  set  of  cost  data  we  collected  was  for  the  purpose  of  testing  the 
reliability  of  our  estimated-cost  formulas.  We  wanted  to  determine  whether  the 
discrepancies  between  the  measured  and  predicted  costs  of  a production  system  would 
vary  if  the  number  of  productions  and  the  size  of  working  memory  were  held  constant, 
but  fhe  stimuli  presented  to  the  production  system  were  varied.  We  reasoned  that  if 
the  discrepancies  between  measured  and  predicted  costs  did  not  remain  relatively 
constant,  then  the  cost  of  a production  system  would  be  too  highly  task  dependent  for 
the  formulas  to  be  considered  meaningful.  The  production  system  we  selected  for  this 
test,  PSCCl,  was  designed  to  simulate  the  performance  of  human  subjects  on  a task 
described  by  Chase  and  Clark  [1972].  They  used  this  task  to  study  the  mental 
processes  people  use  in  deciding  whether  of  not  a sentence  is  an  accurate  description 
of  a picture. 
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j The  task  itself  involves  presenting  a subject  with  (1)  one  of  of  the  eight 

sentences  which  can  be  formed  by  using  star  or  plus  as  subject,  js  or  isn’t  as  verb, 
above  or  below  as  preposition,  and  then  plus  or  star  (whichever  was  not  used  as 
I i subject)  as  the  object  of  the  preposition,  and  (2)  a picture  of  a ♦ and  a +,  one  above 

• ! the  other.  The  subject  then  indicates  whether  the  sentence  is  true  of  the  picture.  For 

instance,  star  is  above  plus  and  */+  is  presented;  and  the  subject  says  yes. 

We  presented  three  of  the  16  possible  sentence-picture  combinations  to 
PSCC).  For  each  set  of  inputs,  runs  on  PSG,  PSG.CmMsFl,  PSG.CmMsF2,  and 
PSG.CmMsFG  were  made.  PSG.CmF  was  not  used.  Given  the  number  of  productions  in 
PSCCl,  space  limitations  made  the  use  of  the  full  CmF  impossible,  and  the  diversity  of 
features  in  PSCCl  was  such  that  no  partial  CmF  was  more  than  minimally 
discriminatory.  PSCCl  has  the  following  parameters: 


Run  1 

Run  2 

Run  3 

p 

40 

40 

40 

CS 

3.09 

2.93 

2.91 

n 

16 

18 

16 

c 

65 

65 

65 

CO 

47 

47 

47 

c.nas 

6 

6 

6 

PF 

25 

25 

25 

F 

105 

105 

185 

FV 

37 

37 

37 

LPF 

.77 

.77 

.77 

NTC 

20 

20 

20 

n 

81 

01 

81 

All  the  static  parameters  are  identical;  only  CS  varies  slightly  for  each  run.  For 
CmMsF2’s  representation  of  condition  elements,  SFL  » 43,  for  CmMsFS’s 

representation,  SFL  = 45.  PSCCl  uses  production  order  for  conflict  resolution;  thus, 
only  one  (the  first)  satisfied  production  is  found,  not  the  entire  conflict  set. 

Although  there  arc,  as  Table  1 shows,  significant  discrepancies  between  the 
predicted  and  measured  costs  for  this  task,  the  discrepancies  remain  constant  across 
all  of  the  runs  and  are  due  to  some  of  the  distribution  assumptions  which  we  made,  not 
to  an  incorrect  characterization  of  the  interdependencies  among  the  production  system 
parameters. 

The  measured  costs  for  each  of  the  PSSCl  runs  on  PSG  are  greater  than  our 
predicted  costs  by  about  a factor  of  1.5.  This  discrepancy  can  be  accounted  for 
almost  entirely  by  our  inability  to  estimate  accurately  the  number  of  productions  which 
need  to  be  considered  before  the  first  satisfied  production  is  found.  The  formula 
which  we  use  to  estimate  this  number,  (P  - CS)/(CS  + 1),  presupposes  that  the 
satisfied  productions  are  evenly  distributed  among  the  productions  in  production 

memory  and  thus  that  roughly  1/CS  productions  will  be  tried  in  each  cycle.  In  PSCCl,  | 

however,  one  production,  Ihe  thirly-fourlh,  is  fired  far  more  frequently  than  any  of 

the  others,  and  consequently,  on  the  average,  19  productions  are  tried  before  the  first  I 

satisfied  one  is  found.  Since  production  systems  could  be  written  containing  a * 

production  functionally  equivalent  to  the  thirty-fourth,  but  either  much  closer  to  the  j 

front  or  to  the  end  of  production  memory,  an  accurate  prediction  of  the  number  of  | 

) 
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- 

SI Inulus 

Sot  1 

Stlaulus  Sot  2 

StiMiUS 

Sat  3 

i 

pradletad 

pradletad  aaasurad 

pradletad 

Baaaurod 

PSC 

r 1 1 tar  coat 

e 

0 

9 

0 

0 

0 

Condi t Ion  cost 

S988 

9423 

5239 

9320 

6261 

9309 

P.considarad 

19. 02 

19.10 

19.43 

10.47 

10.40 

16.47 

C. const darad 

10.04 

21.52 

11.29 

29.01 

11.31 

20.62 

(1CH4P- 

.20 

3.10 

.21 

3.16 

.21 

3.11 

. 

nCH-P- 

145.03 

205.93 

152.45 

275.95 

153.27 

277.07 

nCH+P+ 

1.40 

1.39 

1.40 

1.33 

1.40 

1.33 

ncH-p* 

13.40 

5.23 

13.40 

4.95 

13.46 

4.96 

Ret  Ion  cost 

145 

179 

145 

103 

145 

179 

Total  cost 

0134 

9593 

0370 

9512 

0406 

9569 

PSG.CmnsFl 

' 

F 1 1 tar  cost 

121 

139 

121 

160 

121 

151 

: 

Condition  cost 

252 

940 

252 

1093 

252 

Ills 

P* 

5.53 

7.00 

5.24 

7.01 

5.21 

7.76 

P.considarad 

1.00 

2.02 

1.59 

2.04 

1.59 

2.69 

C . cons  1 darad 

2.30 

4.73 

2.29 

4.74 

2.29 

4.69 

ncH*p- 

.07 

2.75 

.90 

2.72 

.00 

2.64 

ncH-p- 

.90 

0.23 

.97 

9.07 

.97 

9.47 

ncH4P« 

1.40 

1.39 

1.40 

1.33 

1.40 

1.33 

tICH-P* 

2.40 

3.09 

2,40 

2.74 

2.40 

2.71 

Ret  ion  cost 

145 

173 

145 

190 

145 

199 

■ 

Total  cost 

520 

1202 

519 

1452 

519 

1469 

: 

PSG.CmnsF2 

F 1 1 tar  cost 

254 

290 

254 

397 

254 

336 

Condition  cost 

221 

920 

221 

930 

221 

967 

. 

P* 

3.03 

5.70 

3.63 

5.69 

3.61 

5.66 

P.considarad 

1.10 

2.52 

1.10 

2.51 

1.10 

2.49 

C. const darad 

1.04 

4.39 

1.04 

4.37 

1.04 

4.33 

nCH+P- 

.93 

2.70 

.04 

2.67 

.04 

2.60 

nCH-P- 

.39 

7.00 

.29 

0.23 

.29 

6.67 

ncH*p* 

1.40 

1.30 

1.40 

1.33 

1.40 

1.33 

ncH-p* 

2.40 

3.07 

2.40 

2.74 

2.40 

2.71 

Ret  Ion  cost 

145 

100 

145 

194 

145 

197 

Total  cost 

021 

1411 

621 

1432 

621 

1502 

PSG.CnnsF3 

F 1 1 tor  cost 

410 

403 

410 

491 

416 

496 

Condition  cost 

219 

929 

219 

922 

219 

952 

Pa 

3.71 

5.52 

3.52 

5.42 

3.50 

5.42 

P . cons  1 darad 

1.15 

2.43 

1.15 

2.42 

1.15 

2.46 

C. const darad 

1.01 

'..30 

1.01 

4.20 

1.61 

4.24 

nCHaP- 

.03 

2.70 

.03 

2.67 

.03 

2.60 

KCH-P- 

.25 

7.57 

.25 

0.14 

.25 

6.56 

nCHaPa 

1.40 

1.30 

1.40 

1.33 

1.46 

1.33 

nCH-Pa 

2.40 

3.07 

2.40 

2.74 

2.46 

2.71 

Ret  Ion  cost 

145 

192 

145 

197 

145 

197 

Total  cost 

703 

1505 

703 

1610 

783 

1646 

Tab  la 

1.  Par  eyela  Haas 

(in  Bl  II  Isaconds) 

and  counts 

tor  PSCCl 
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productions  which  will  be  tried  in  each  cycle  is  impossible  to  obtain  without  a fairly 
clear  idea  of  the  intended  role  of  each  production.  If  it  had  been  known  that  19 
productions  would  be  considered  in  each  cycle,  then  our  formula  would  have  yielded  a 
far  more  accurate  estimate  of  the  cost.  In  the  first  run,  for  example,  the  predicted 
number  of  condilion  elements  considered  would  have  been  20.23,  MCH-P-  would  have 
been  292.25,  and  the  condition  cost  would  have  been  10540  ms. 

The  other  significant  discrepancies  in  the  PSG  runs  are  in  k^H+P-,  MCH-P+, 
and  T.MCH-.  Again,  using  the  first  run  as  an  example,  if  P.considered  had  been 
accurately  estimated,  MCH+P-  would  have  been  .38.  Of  the  six  productions  containing 
ABS  condition  elements,  three  are  designed  in  such  a way  that  the  ABS  element  (which 
is  the  second  element  in  all  three  productions)  is  the  principal  discriminator;  that  is,  the 
first  condilion  element  in  each  of  these  throe  productions  matched  a memory  element 
.64  times  per  cycle.  If  this  had  been  taken  into  account  as  well,  then  MCH+P-  would 
have  been  2.30.  MCH-P+  is  inaccurately  predicted  because  our  formula  presupposes 
that,  on  the  average,  each  condition  element  will  match  the  middle  element  in  working 
memory,  which  in  the  case  of  PSSCl  is  the  seventh  or  eighth.  Had  we  assumed  instead 
that  the  fourth  or  fifth  memory  element  would  be  the  supporting  element,  then  MCH-P+ 
would  have  been  approximately  5.  The  actual  cost  of  matching  a condition  element  in 
PSSCl  with  a memory  element  which  does  not  support  it  is  approximately  32  ms;  Our 
estimate  was  36.6  ms.  To  predict  this  cost  more  accurately,  one  would  have  to  collect 
relatively  complete  information  about  the  make-up  of  each  condition  element. 

The  discrepancies  between  the  predicted  and  measured  costs  in  PSG.CmMsFl, 
PSG.Cmk'tr.rZ,  and  PSG.Cmk'tsF3  are  primarily  due  to  our  inability  to  estimate  accurately 
the  size  of  the  P+  set.  Our  estimate  is  low  for  all  three  of  the  runs  with  each  of  the 
three  fillers  because  our  PSG.CmMsF  formula  is  built  on  the  assumption  that  ABS 
condition  elements  can  be  ignored  when  trying  to  determine  the  probability  that  any 
given  production  will  be  satisfied.  This  assumption  is,  of  course,  simplistic,  since  as  we 
saw  in  the  discussion  of  the  PSG  discrepancies  above,  there  is  a production  writing 
style  in  which  an  ABS  condition  element  is  the  principal  discriminator  in  a production. 
In  the  case  of  the  first  PSG.CmMsFl  run,  for  example,  an  average  of  three  productions 
containing  an  ABS  condition  element  are  in  the  P+  set  in  each  cycle.  That  is,  39^  of 
the  productions  which  contain  an  ABS  condition  element  are,  on  the  basis  of  the 
information  in  the  KSs,  possibly  satisfied.  However,  only  87,  of  the  productions  not 
containing  an  ABS  condition  element  are  in  the  P+  set.  If  our  formula  were  modified  so 
that  it  could  lake  this  additional  information  into  accoutd,  the  estimated  size  of  the  P+ 
set  would  be  7.1.  The  only  other  significant  discrepancies  between  ^the  predicted  and 
measured  costs  in  the  PSG.CmMsF  runs  are  with  MCH+P-  and  MCH-P-.  Here,  as  well, 
the  difference  arises  because  of  the  ABS  condition  elements.  One  production  (as  it 
happens,  the  first  production  in  production  memory)  causes  most  of  the  trouble.  This 
production  has  two  condilion  elements:  In  the  case  of  the  first  PSG.CmMsFl  run,  the 
first  of  these  is  supported  by  a memory  element  877.  of  the  time;  the  second  condition 
element  is  an  ABS  condition  element.  The  production  itself  is  satisfied  only  57  of  the 
time.  Thus,  .82  times  per  cycle,  two  condition  elements  in  an  unsatisfied  production 
are  found  to  be  supported,  and  so  taking  just  this  one  production  into  account,  K4CH+P- 
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would  be  1.64.  This  same  production  accounts  to  a considerable  extent  for  the 
MCH-  P-  discrepancy.  If  our  formula  had  assumed  that  half  of  the  elements  in  working 
memory  would  be  examined  before  each  of  the  two  supporting  memory  elements  were 
found,  the  predicted  value  of  MCH-P-  would  have  been  12.3. 

PS20Qj  Testing  Variations  in  the  Number  of  Productions 

Our  purpose  in  gathering  the  second  set  of  cost  data  was  to  determine  the 
relationship  between  the  number  of  productions  in  production  memory  and  the  cost  of 
processing  a production  system,  both  with  and  without  a filter.  In  order  to  measure 
the  effect  of  varying  production  memory  size,  we  used  a production  system  containing 
productions  almost  all  of  which  are  of  the  same  form.  The  production  system,  PS20Q, 
plays  the  game  of  twenty  questions.  Except  for  three  control  productions,  each 
production  in  the  system  is  a member  of  a three  production  set  which  encodes 
information  about  a category.  One  production  in  the  set  associates  a category  with  a 
sub -v  ategory.  Another  associates  the  category  with  another  category  within  the  same 
super-category.  The  third  provides  a mechanism  by  which  the  production  system  can 
acquire  knowledge  of  additional  sub-categories.  For  example,  the  following  information 
about  the  category  citrus  fruit  might  be  represented:  (1)  A lime  is  a citrus  fruit.  (2)  A 
banana  is  another  hind  of  fruit.  (3)  If  there  is  another  citrus  fruit  besides  the  lime, 
then  it  should  be  associated  with  the  lime.  Because  information  about  each  category  is 
encoded  in  a homogeneous  fashion,  the  values  of  the  production  system  parameters 
vary  directly  with  the  number  of  productions. 

The  first  run  of  PS20Q  was  with  50  productions;  before  each  of  the  two 
subsequent  runs,  an  additional  50  productions  were  added  to  production  memory.  In 
all  three  cases,  the  production  system  (unbeknownst  to  itself)  was  looking  for  the  same 
answer.  For  each  set  of  productions,  runs  on  PSG,  PSG.CmF,  PSG.CmMsFl,  and 
PSG.CmMr.F2  were  made.  PSG.CmMsF3  was  not  used  since  PSG.CmMsF2  was  fully 
discriminating!  that  is,  the  P+  set  was  the  conflict  set.  The  PSG.CmF  runs  were  with  a 
partial  filter;  only  four  features  were  used.  PS20Q  has  the  following  parameters: 

Run  3 
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112 
628 
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.38 
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PS20Q  uses  working  memory  order  for  conflict  resolution;  thus  in  this  case,  PSG  finds 
all  satisfied  productions  before  selecting  one  to  fire. 

As  is  evident  from  Table  2,  the  predicted  costs  for  the  PS20Q  runs  are  much 
closer  to  the  measured  costs  than  was  the  case  in  the  previous  task.  This  is  due 


Run  1 

Run  2 

p 

50 

108 

cs 

1.13 

1.13 

n 

7 

7 

c 

168 

322 

CO 

45 

76 

C.RB9 

8 

0 

PF 

29 

48 

SFl. 

44 

75 

F 

197 

485 

FV 

8 

8 

tPF 

.28 

.38 

NIC 

57 

185 

fl 

413 

787 

22 


58  Productions 

188  Productions 

158  Productions 

predicted 

measured 

predicted  measured 

predicted 

measured 

PSC 

F i 1 tar  cost 

8 

8 

8 

8 

8 

8 

Condi t ion  cost 

8487 

9422 

16816 

18888 

25889 

27269 

P. cons i derad 

58.88 

58.88 

188. 88 

188, 88 

158.88 

158.88 

C.considorad 

53.68 

68.96 

183.83 

117.13 

153.85 

173.17 

t1CH+P- 

l.ll 

7.17 

1.32 

13.35 

1.33 

19.39 

ncH-p- 

345.42 

393.13 

696.84 

799.22 

1846.87 

1285.17 

nCH+P+ 

3.62 

2.52 

3.64 

2.52 

3.66 

2.52 

NCH-P+ 

18.85 

1.35 

18.92 

1.35 

18.97 

1.35 

Ret  Ion  cost 

594 

458 

566 

454 

558 

443 

Total  cost 

9882 

9872 

17383 

19334 

25567 

27713 

PSC.CnF 

F i 1 tar  cost 

126 

122 

126 

138 

126 

141 

Cond i t ion  cost 

2331 

2266 

4428 

4615 

6477 

8681 

P* 

12.58 

11.39 

25.88 

21.65 

37.58 

32.13 

P. considered 

12.58 

11.39 

25.88 

21.65 

37.58 

32.13 

C. consider ad 

15.28 

22.17 

27.81 

38.61 

48.33 

55.13 

ttCH+P- 

.29 

7.88 

.38 

13.17 

.38 

19.22 

ncH-p- 

88.46 

84.38 

167.99 

172.48 

255.49 

262.26 

HCH+P+ 

3.62 

2.52 

3.64 

2.52 

3.66 

2.52 

HCH-P+ 

18.85 

1.35 

18.92 

1.35 

18.97 

1.35 

Ret  ion  cost 

594 

422 

566 

448 

558 

448 

Total  cost 

3851 

2811 

5121 

5194 

7162 

7122 

PSG.CmnsFl 

F 1 1 ter  cost 

382 

252 

475 

586 

478 

758 

Condi t Ion  cost 

144 

258 

147 

324 

147 

377 

P+ 

1.93 

1.17 

2.84 

1.26 

2.84 

1.35 

P. considered 

1.37 

1.84 

1.43 

1.84 

1.43 

1.84 

C. considered 

3.65 

2.52 

3.72 

2.52 

3.74 

2.52 

nCH+P- 

.87 

.89 

.88 

.89 

.88 

.89 

nCH-P- 

.37 

.84 

.43 

.84 

.43 

.84 

MCH+P+ 

3.28 

2.39 

3.22 

2.39 

3.23 

2.39 

t1CH-P+ 

.88 

.88 

.88 

.88 

.88 

.88 

Ret  Ion  cost 

594 

464 

566 

476 

558 

478 

Total  cost 

1129 

966 

1188 

1387 

1176 

1615 

PSG.CmnsF2 

F 1 1 tor  cost 

988 

775 

1894 

1296 

1887 

1894 

Cond i t Ion  cost 

148 

251 

143 

325 

143 

412 

P+ 

1.69 

1.13 

1.78 

1.13 

1.78 

1.13 

P. considered 

1.26 

1.88 

1.38 

1,88 

1.38 

1.88 

C.considorad 

3.52 

2.39 

3.59 

2.39  , 

3.68 

2.39 

nCH+P- 

.86 

.88 

.86 

.88 

.86 

.88 

ncH-p- 

.26 

.88 

.38 

.88 

.38 

.88 

HCH+P+ 

3.28 

2.39 

3.22 

2.39 

3.23 

2.39 

HCH-P+ 

.88 

.88 

.88 

.88 

.88 

.88 

Ret  Ion  cost 

594 

478 

566 

472 

558 

479 

Total  cost 

1643 

1584 

1884 

2896 

1789 

2786 

TabI*  2 
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partly  to  the  similarity  in  form  of  most  of  the  productions  and  partly  to  the  use  of 
working  memory  order  rather  than  production  order  as  the  conflict  resolution  strategy. 

Figure  3,  which  plots  total  cost  as  a function  of  the  size  of  production  memory,  shows 
very  clearly  the  value  of  the  two  filters. 

Because  PS20Q  uses  working  memory  order,  there  is  no  difficulty  in  predicting 
for  PSG  the  exact  number  of  productions  which  will  be  considered  in  each  cycle. 

However,  because  of  the  particular  character  of  the  productions  in  PS20Q,  there  is  a 
discrepancy  between  the  predicted  number  of  condition  elements  considered  and  the 
measured  number.  The  character  of  the  productions  is  such  that  production  memory 
can  bo  partitioned  into  four  subsets;  one  of  these  sets  contains  three  productions;  the 
other  three  sets  each  contain  approximately  1/3  of  the  remaining  productions,  and 
each  production  in  each  set  has  the  same  first  condition  element.  Since  one  of  these 
throe  condition  elements  is  supported  every  other  cycle,  we  could  predict  that 
C.considered  would  be  60.82  when  production  memory  contained  50  productions, 

119.17  when  production  memory  contained  100  productions,  and  177.53  when 
production  memory  contained  150  productions.  Because  of  these  three  sets  of 
productions  with  the  same  first  condition  element,  there  is,  ot  course,  a significant 
discrepancy  between  the  predicted  and  measured  values  of  MCH+P-;  but  if  this  fact 
were  taken  into  account,  the  predicted  values  of  MCH+P-  for  the  three  runs  would  be  ! | 

approximately  7.3,  15.6,  and  7A.  The  discrepancy  in  MCH+P+  exists  because  the  three  | 

control  productions  which  are  fired  about  half  of  the  time  each  have  only  two  condition  \ 

elements,  rather  than  the  3 or  4 of  the  remaining  productions.  | 

The  two  remaining  significant  discrepancies  are  in  MCH-P+  and  MCH-P-.  The 
MCH-P+  discrepancy  in  PS20Q  is  similar  to,  but  more  pronounced  than,  the  MCH-P+  I 

discrepancy  in  PSCCl.  Here,  as  before,  the  difficulty  is  with  our  assumption  that  on  ! 

the  average,  half  of  the  elements  in  working  memory  will  be  considered  before  the  ! 

supporting  element  is  found.  In  the  case  of  PS20Q,  only  one  element  is  considered.  j 

The  discrepancy  between  the  predicted  and  measured  values  of  MCH-P-  is  due  to  an 
implementation  feature  of  PSG  which  was  not  discussed  above  and  which  is  not 
reflected  in  our  formulas.  When  the  conflict  resolution  strategy  being  employed  is 
wo.-king  memory  order,  PSG  adds  a special  symbol  to  working  memory  to  mark  the  .! 

location  of  the  memory  element  closest  to  the  front  of  working  memory  that  supports  a ' ! 

condition  element  in  a satisfied  production.  If  the  number  of  matches  in  which  this 
symbol  participates  were  subtrrrted  from  the  measured  value  of  MCH-P-,  the  resulting 
measured  value  for  MCH-P-  wouid  be  very  close  to  the  predicted  value;  in  the  first  : 

run,  for  example,  the  measured  value  would  be  344.26.  This  adjustment  would,  in  turn, 
lead  to  a modification  in  the  measured  condition  cost  of  approximately  1 100  ms.  ‘ 

The  discrepancies  in  the  three  runs  with  the  partial  CmF  are  almost  identical  to 
the  discrepanci«»e  in  the  PSG  runs,  The  one  discrepancy  which  perhaps  needs  some 
comment  is  the  MCH-P-  discrepancy.  It  the  measured  value  for  the  first  PSG.CmF  run 
were  adjusted  as  above,  MCH-P-  would  be  74.04  and  the  measured  condition  cost 
would  then  be  approximately  2000  ms.  Given  these  adjustments,  the  predicted  total 
cost  for  these  three  runs  would  increase  slightly. 

There  are  two  significant  discrepancies  in  the  PSGLCmMsFl  and  PSG.CmMsF2 


4 


Measured  • 

PREPICTCP- 


Milliseconds 


Productions 


Figure  3.  Per  cycle  cost  of  PSZOQ  on  PSG, 
PSG.CmF,  PSG.CmMsFl,  AND  PSG.CmMsFZ 
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runs.  In  both  sots  of  runs,  the  measured  filter  costs  and  the  measured  condition  costs 
increase  with  the  si;;e  of  production  memory  whereas  the  predicted  costs  remain 
relatively  constant.  This  would  suggest  that  there  is  a dependency  in  both  cases  on 
the  number  of  productions  in  production  memory  --  a dependency  which  our  formula 
does  not  capture.  In  the  case  of  the  condition  cost,  there  is  such  a dependency.  The 
filters  have  been  implemented  in  such  a way  that  rather  than  updating  the  P+  set  at 
the  beginning  of  each  cycle,  the  filter  simply  updates  a flag  on  each  production  which 
irulicates  whether  or  not  it  is  satisfied.  PSG  then  generates  the  P'*^  set  by  checking  the 
flag  on  each  production.  The  cost  of  this  check  is  approximately  1.5  ms  per 
production.  In  the  case  of  the  filter  cost,  on  the  other  hand,  the  dependency  is  only 
apparent.  The  actual  dependency  is  on  the  number  of  condition  elements  associated 
with  each  primary  feature.  In  PS20Q,  however,  the  number  of  condition  elements 
associated  with  four  of  the  primary  features  is  directly  proportional,  as  we  mentioned 
above,  to  the  number  of  productions  in  production  memory. 

PSSTftN:  Testing  Variations  in  the  Size  of  Working  Memory 

The  purpose  of  the  third  set  of  cost  data  was  to  determine  the  relationship 
between  the  size  of  working  memory  and  the  cost  of  processing  a production  system, 
both  with  and  without  a filter.  To  determine  the  effect  of  working  memory  size,  we 
used  a production  system,  PSSTPN,  which  can  do  three  related  tasks:  (1)  It  can  do  the 
Sternberg  binary  classification  task  [Newell,  1973].  In  this  task,  the  subject  is  given  a 
small  set  of  symbols,  called  the  positive  set,  and  then  another  symbol,  called  the  probe; 
the  task  is  to  determine  whether  or  not  the  probe  is  in  the  positive  set.  (2)  It  can 
determine  whether  the  same  probe  ha.,  been  given  before.  (3)  It  can  look  for  a 
pattern  in  its  yes  or  no  answers  to  the  Sternberg  task.  The  effect  of  working  memory 
size  was  determined  by  selecting  three  different -sized  working  memories  in  such  a 
way  that  the  same  sequence  of  productions  fired,  but  a larger  number  of  condition 
elements  (the  number  being  proportionate  to  the  number  of  memory  elements  added) 
were  satisfied  during  each  run. 

For  the  first  run  of  PSSTRN,  four  elements  were  in  working  memory,  for  the 
second,  an  additional  three,  and  then  three  more  for  the  third  run.  For  each  working 
memory,  runs  on  PSG,  PSG.CmF,  PSG.CmMsFl,  and  PSG.CmMsF2  were  made.  As  with 
PS20Q,  PSG.CmMsF2  was  fully  discriminating  and  so  PSG.CmMsF3  was  not  used. 
PSSTRN  has  the  following  parameters: 


Run  1 
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p 

24 

24 

< 24 

cs 

2.48 

6.58 

6.78 

n 

4 

7 

18 

c 

50 

58 

58 

CD 

27 

27 

27 

c.nns 

2 

2 

2 

PF 

17 

17 

17 

SFL 

26 

26 

26 

F 

85 

85 

85 

FV 

27 

27 

27 

LPF 

.79 

.79 

.70 

NTC 

28 

28 

28 

n 

54 

54 

64 
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The  predicted  costs  for  the  PSG.CmF  runs  are  for  the  complete  17  level  (17  PF)  net; 
however,  space  limitations  made  it  impossible  to  use  the  full  filter  and  so  the  runs 
were  made  with  a net  of  ten  levels  instead.  This  partial  filter  was  as  discriminating  as 
the  full  filter  would  have  been  and  so  except  for  a slight  difference  in  filter  cost,  our 
predicted  costs  are  the  same  as  they  would  have  been  had  we  been  able  to  use  the 
full  filter.  Working  memory  order  was  used  as  the  conflict  resolution  strategy. 

As  Table  3 shows,  the  discrepancies  between  the  predicted  and  measured  costs 
for  PSSTRN  are  not  completely  consistent  across  the  runs.  This  is  primarily  because 
there  is  a wide  variance  in  the  number  of  condition  elements  that  each  of  the  memory 
elements  support  or  appear  to  support.  The  effect  of  this  lack  of  uniformity  of 
support  can  be  seen  in  Figure  4,  where  total  cost  is  plotted  as  a function  of  working 
memory  size. 

In  the  first  PSG  run  the  predicted  costs  are  very  close  to  the  actual  costs 
when  one  takes  into  account  the  special  symbol  added  to  working  memory  to  effect 
production  selection  during  conflict  resolution.  The  measured  value  of  MCH-P-  would 
be  85.80  and  the  adjusted  condition  cost  would  be  approximately  4500  ms.  ^ In  the 
second  PSG  run  the  adjusted  value  of  MCH-P-  would  also  be  approximately  the  same 
as  the  predicted  value,  but  in  the  third  run  the  adjusted  value  would  be  significantly 
less  than  the  predicted  value.  In  all  three  runs  the  predicted  value  of  MCH+P-  is  too 
low  because  our  formula  presupposes,  as  we  indicated  above,  that  no  condition 
element  is  more  likely  to  be  supported  than  any  other  condition  element.  However,  in 
PSSTRN,  the  sets  of  productions  that  do  each  subtask  are  partially  distinguished  from 
one  another  by  control  elements  (condition  elements  whose  only  function  is  to  make 
Ihe  order  in  which  productions  are  fired  easier  to  control).  Since  the  control  elements 
in  this  production  system  are  always  the  first  elements  in  the  productions,  the  first 
element  in  each  of  the  productions  involved  in  the  subtask  being  addressed  is  more 
likely  to  be  supported  than  other  condition  elements.  There  is  a discrepancy  in  the 
second  and  third  runs  which  is  not  present  in  the  first.  In  both,  the  predicted  value  of 
MCH+P+  is  too  high  be.ause  Ihe  average  number  of  condition  elements  in  the 
productions  which  are  satisfied  is  much  less  than  the  average  number  of  condition 
elements  in  the  entire  set  of  productions.  In  the  third  run,  but  not  in  the  other  two, 
the  predicted  value  of  KCH-P+  is  loo  high.  It  is  clear  that  since  the  three  memory 
elements  added  lo  working  memory  did  not  appreciably  affect  the  size  of  the  conflict 
set,  those  three  memory  elements  are  minimally  involved  in  supporting  condition 
elements;  consequently,  the  supporling  memory  eioment  is  almost  always  found  before 
those  elements  rould  be  matched  with  a condition  element.  , 

The  discrepancies  in  all  throe  runs  of  PSSTRN  on  PSG.CmF  are  for  the  most 
part  due  to  our  inaccurate  estimates  of  the  size  of  the  P+  sets.  In  both  the  first  and 
the  third  run,  our  estimate  is  too  low  for  reasons  analogous  to  those  given  in  our 
discussion  of  PSCCl.  In  the  second  run,  our  estimate  is  too  high,  primarily  because 


4 This  is  still  too  high  because  in  PSSTRN  the  cost  of  matching  a condition  element 
with  a memory  element  which  does  not  support  it  Is  approximately  40  ms,  rather 
than  36. 
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9.68 
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2.78 

2.38 

2.78 

2.38 

nCH+P- 

.86 

.58 

.83 

.58 

.83 

.58 

nCH-P- 

.58 

.28 

.65 

.28 

.69 

.28 

ncH4P« 

2.88 

1.58 

2.H 

1.58 

2.88 

1.58 

ncH-p* 

.33 

.28 

.58 

.58 

.83 

.88 

Action  cos t 

162 

225 

162 

227 

162 

227 

Total  cost 

528 

718 

543 

753 

556 

831 

. 

PSG.CMt1sF2 

FI  Iter  cost 

369 

286 

369 

287 

369 

288 

Condition  cost 

198 

356 

211 

417 

222 

484 

■ 

P* 

3.26 

3.58 

8.83 

7.68 

9.18 

11.88 

P. const  dared 

1.25 

1.48 

1.31 

1.48 

1.31 

1.48 

C. cons  I dared 

2.38 

2.38 

2.41 

2.38 

2.41 

2.38 

■ 

HCH*P- 

.84 

.58 

.82 

.58 

.82 

.68 

nCH-P- 

.26 

.28 

.34 

.28 

.36 

.28 

nCHfP« 

2.88 

1.58 

2.88 

1.58 

2.88 

1.58 

HCH-P* 

.33 

.28 

.58 

.58 

.83 

.88 

Action  cost 

162 

226 

162 

228 

162 

228 

■ 

Total  cost 

729 

789 

742 

852 

754 

931 

1 

i 

I 

Table  3. 

Per  cycle 

tines  (In 

Ml  1 1 Isaeonds) 

and  counts 

for  PS9TIW 

1 

i 

I 
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production  memory  contain;;  two  productions  which  are  in  the  conflict  set  on  almost 
every  cycle,  but  which  are  similar  to  no  other  productions  in  production  memory.  The 
K4CH-»P+  and  MCH-P*  discrepancies  arise,  of  course,  for  the  reasons  given  in  our 
discussion  of  the  runs  on  PSG.  Except  for  Ihe  P+  set  predictions  in  the  second  run  on 
PSG.CmMsF I and  Ihe  third  run  on  PSG.CtiiMsF^,  our  PSG.CmMsF  formula  was  quite 
accurate.  These  two  discrepancies,  as  well  as  the  filter  cost  discrepancies,  arise  for 
reasons  given  above. 


Milliseconds 


Memory  elements 


Figure  4.  Per  cycle  cost  of  P5STRN  on  PSG, 
PSG.CmF,  PSG.CmMsFl,  AND  PSG.CmMsFZ 


Conclusions 


As  we  stated  at  the  beginning  of  section  III,  our  purpose  in  generating  the 
estimated-cost  formulas  was  primarily  to  provide  a means  for  studying  the  effect  of  a 
variety  of  production  system  parameters  on  the  cost  of  processing  a production 
system.  Our  discussion  of  the  discrepancies  between  the  predicted  and  actual  costs  of 
processing  the  three  production  systems  has,  we  think,  shown  that  in  spite  of  the 
inadequacy  of  our  various  statistical  assumptions,  our  cost  formulas  do  capture  the 
most  important  dependencies.  Though  many  things  are  involved,  the  factor  which 
stands  out  as  the  single  most  important  determinant  for  a production  system 
architecture  not  augmented  by  a filter  is  MCH-P-,  the  number  of  attempted  matches  of 
a condition  element  in  an  unsatisfied  production  with  a memory  element  which  does  not 
support  it.  It  is  this  factor  that  our  two  filters  deal  with  most  successfully. 

The  two  graphs  (Figures  3 and  4)  show  very  clearly  that  the  cost  of  running  a 
production  system  on  PSG  is  almost  directly  proportional  to  the  product  of  the  number 
of  productions  in  production  memory  and  the  number  of  elements  in  working  memory. 
The  filter  (CmF)  which  makes  use  of  jusi  the  Condition-membership  KS  eliminates  the 
dependency  on  the  number  of  productions  by  making  the  number  of  unsatisfied 
productions  tested  dependent  on  CS  rather  than  on  P.  The  filter  (CmMsF)  which 
utilises  both  the  Condition-membership  KS  and  the  Memory-support  KS  eliminates  the 
memory  size  dependency  as  well  by  eliminating  the  need  to  search  working  memory. 

CmF  and  CmMsF  both  show  that  large  increases  in  efficiency  can  be  gained  by 
using  simple  filtering  mechanisms.  Although  a CmF,  because  it  cannot  eliminate  the 
working  memory  dependency,  ,s  perhaps  not  of  much  use  in  practical  applications, 
CmMsFs  appear  to  have  the  necessary  power:  neither  the  cost  of  maintaining  the  KSs 
nor  the  cost  of  finding  the  satisfied  productions  is  dependent  on  production  memory  or 
working  memory  size.  Moreover,  CmMsFs  are  highly  effective  even  when  the 
information  in  the  Condition-membership  and  Memory-support  KSs  is  very  incomplete, 
as  is  the  case  with  CmMsFl. 
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